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Boltzmann selection is an important selection mechanism in evolutionary algorithms as it has 
theoretical properties which help in theoretical analysis. However, Boltzmann selection is not used 
in practice because a good annealing schedule for the 'inverse temperature' parameter is lacking. 
In this paper we propose a Cauchy annealing schedule for Boltzmann selection scheme based on 
a hypothesis that selection-strength should increase as evolutionary process goes on and distance 
between two selection strengths should decrease for the process to converge. To formalize these 
aspects, we develop formalism for selection mechanisms using fitness distributions and give an 
appropriate measure for selection-strength. In this paper, we prove an important result, by which 
we derive an annealing schedule called Cauchy annealing schedule. We demonstrate the novelty of 
proposed annealing schedule using simulations in the framework of genetic algorithms. 



PACS numbers: 



I. INTRODUCTION 

Selection is a central concept in evolutionary algo- 
rithms. There are several selection mechanisms in ge- 
netic algorithms, like proportionate selection, ranking se- 
lection, tournament selection, truncation selection and 
Boltzmann selection |3j . Among all these selection mech- 
anisms, Boltzmann selection has an important place be- 
cause it has some nice theoretical properties in some mod- 
els of evolutionary algorithms For example, Boltz- 
mann selection is extensively used in statistical mechan- 
ics theory of evolutionary algorithms 0, 0, 0, 0] . 

Moreover, Boltzmann selection scheme is not used of- 
ten in solving practical problems because, similar to sim- 
ulated annealing, it needs an annealing schedule for per- 
turbing the value of inverse temperature parameter used 
in Boltzmann selection, which is difficult to choose \ 
This problem is well known from simulated annealing 
an optimization algorithm where noise is introduced by 
means of a formal temperature. Lowering, or "anneal- 
ing," the temperature from high to low values in the 
course of the optimization leads to improved results com- 
pared to an optimization at fixed temperature 0. How- 
ever, there remains the problem of choosing a suitable an- 
nealing schedule for a given optimization problem. The 
same problem occurs in population-based optimization 
algorithms, and this paper address this problem for evo- 
lutionary algorithms. 

Usually, in evolutionary algorithms, probabilistic se- 
lection mechanisms are characterized by selection prob- 
abilities 0. For a population P = {^i}™^, selection 
probabilities are defined as, 



Pi = Prob(wi 6 selection(P)|o^ G P) Mi = 1 . 
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'Electronic address: ambedkar@csa.iisc.ernet.in 

Electronic address: Im n m CciicKa.iisc.ernet, . inl 
t Electronic address: shalabh@csa.iisc.ernet.in 



and {pi}™^ satisfies the condition: Y^iZ\Pi = 1- 

Let {/(wi)}"=i be the corresponding fitness values. 
The proportionate selection assigns selection probabili- 
ties according to the relative fitness of individuals as : 



E£i/("j) ■ 



(i) 



Similarly Boltzmann selection is represented as [To|: 



(2) 



where 7 is called inverse temperature. The strength of 
selection is controlled by the parameter 7. A higher value 
of 7 (low temperature) gives a stronger selection, and a 
lower value of 7 gives a weaker selection. For details of 
representation of other selection mechanisms refer 0, U 

Some properties of selection mechanisms that are de- 
sirable in order to control the search process are 0: 

• The impact of the control parameters on selective 
pressure should be simple and predictable. 

• One single control parameter for selective pressure 
is preferable. 

• The range of selective pressure that can be realized 
by varying the control parameter should be as large 
as possible. 

Boltzmann selection satisfies above properties. Boltz- 
mann selection gives faster convergence, but without 
good annealing schedule for 7, it might lead to premature 
convergence. 

In this paper we propose Cauchy criteria for choosing 
the Boltzmann selection schedule. Based on this we de- 
rive an annealing schedule for the inverse temperature 
parameter 7, using a result we proved. Since selection 
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depends only on the fitnesses of candidate solutions of 
population, in this paper we characterize the selection 
using normalized fitness distribution (normalized fitness 
distribution is precisely normalization of fitness distri- 
bution of population) instead of selection probabilities 
which arc defined for all the members of population. We 
also give a new measure for selection-strength which is 
suitable for the theoretical analysis presented in this pa- 
per. 

The outline of the paper is as follows. In § |HJ we 
present the formalization of selection methods. We 
present our main results regarding Cauchy criteria for 
Boltzmann selection schedule in § IIIII We present simu- 
lation results in S IIVI 



Definition II. 3 Normalized fitness distribution (NFD) 
of a population P = {u>k}k=i w ^h fitness distribution p p 
is a function ip p : IR — > [0, 1] defined as 



<p p (x) = 



P P {*) 
np 



(6) 



One can see that ip p is well defined. From 10, we have 



E ^» = 1 

x£E P 



(7) 



Note that supp(f P ) = supp(p p ). Support of a NFD <p of 
population P is represented by E v . 



II. A FORMALIZATION OF SELECTION 
SCHEMES 

A. Definitions 

Let / : fi — > 1R + U {0} be a fitness function, where Q 
is the search space. Let P = {oJk}kZi denote the popula- 
tion. Here we assume that the size of population at any 
time is finite and need not be a constant. 

Fitness distribution is an important macroscopic prop- 
erty of population. Formal definition of fitness distribu- 
tion of a population is given below |5(. 

Definition II. 1 Fitness distribution of a population 
P = {u>k}k=i * s a f unc ti° n p p : K — > ZZ^ U {0} defined 
as 



(3) 



fe=i 



where 5 : IR — > {0,1} is the Kronecker delta function 
defined as S(x) = 1 if x = 0, S(x) = otherwise . 

p p assigns each x 6 IR, the number of individuals in a 
population P carrying x as the fitness value. The finite 
set of values associated with the fitness distribution which 
are mapped to non-zero values is called support of fitness 
distribution of population. 

Definition II. 2 Let p p be the fitness distribution of pop- 
ulation P, then 'support' of p p is defined as 



supp{p P ) = E p (orEp) = {x : p P (x) ? 0} 



(4) 



For any population P, supp(p p ) is finite set, since popu- 
lation size is finite. We can write size of a population P 
in terms of its fitness distribution p p as, 



np = E P P ( a 

xeEp 



(5) 



We now define normalized fitness distribution (NFD). 



B. Representation of Seiection Schemes Via NFD 

Instead of giving a mechanistic view of selection, we de- 
fine selection as an operator on fitness distribution (hence 
on NFD). For that we need to specify the corresponding 
space. 

Definition III .31 gives the definition of "NFD of a popu- 
lation" . To define space of all NFDs we give a generalized 
definition of NFD, similar to the generalized definition of 
fitness distribution given in 0. 

Definition II. 4 'Normalized fitness distribution' (NFD) 
is a function ip : IR — > [0, 1] which satisfies 

"„{x : ip(x) ^ 0} < oo (i.e., §supp((p) < oo) , (8a) 



x£supp(tp) 

where (j denotes the cardinality of a set. 



(8b) 



From Definition ITTT3J one can easily see that every "NFD 
of a population" is indeed an "NFD" . Space of all NFDs 
is denoted by O i.e., 

O = {cp : M -> [0, 1] : $supp(ip) < oo, ^ f( x ) = ^ 

x£supp(ip) 

(9) 

We define selection as an operator T on the space O i.e., 
r : O — * O. At generation k, for a population Pk, with 
fitness distribution p k and population size Nk, Boltz- 
mann selection T can be represented in terms of fitness 
distribution as 



p k+1 {x)=Tp k {x)=p k {x) 



N, 



k+l 



(10) 



where Nk+i is the population size after the selection T 
and E — supp(p k ). From Definition III. 31 we have 

^(x)= T -P^=Ax) P ^ 



ip k (x) 



N, 



k E 



v k {y) 
y&E N k 
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V k+ \x) 



cp k (x)e rx 



Hence Boltzmann selection operator r on O is defined as 



rV(aO = ^ (x)e . 7 ^ yy , Vx e H , V^GO, (11) 

where 7 G M + U {0} corresponds to inverse temperature. 
Similarly we can define proportionate selection using op- 
erator Tprop as follows: 



r p rop^(a;) = |T 



xtp(x) 



y<p(y) 



, Vx e H , V^eO. (12) 



Through out this paper we represent Boltzmann selection 
by r unless mentioned otherwise. 



We give the formal definition of selection strength as 
follows. 

Definition II. 5 Selection strength of a selection scheme 
r with respect to an NFD tp € O is denoted by S v (T) and 
is defined as 



S<p(T) = d(<p,T(p) 



(15) 



For example, for proportionate selection the NFD cp se- 
lection strength can be measured as: 



d(ip,T prop Lp) = ^ 

i£E t 



(f(x) 



xtp(x) 



x£E v 



T, v&Ev y<p{y) 
^ v eE v w(v) - x 



T. v eE v v<p(v) 



(16) 



C. Metric on Space of NFDs 

One can view NFD as a probability distribution and 
one can use various distance measures on it. For example, 
one can use Kullback-Leibler distance measure but it is 
not a metric 0- We define a metric d : O x O — > IR 
according to 

d(<pi,<p2)= 2J \<Pi( x ) ~ ^2 (a) I , V<^i,i/3 2 eO. 

xGE vl UE V2 

(13) 

It is easy to verity that d is indeed a metric on O. 



d(<p, T prop ip) 



(17) 



where fly, = YlxtE x f{ x ) is expectation of (p. The nu- 
merator is nothing but mean absolute error of (p. If one 
observes (|17|) carefully, it justifies the definition of selec- 
tion strength as d(ip,Tip). 



III. CAUCHY CRITERIA FOR BOLTZMANN 
SELECTION SCHEME 

A. Boltzmann Selection Scheme 



D. Selection Strength 

There have been several variants to measure selection 
strength in evolutionary algorithms. The terminology 
"selection intensity" or "selection pressure" is often used 
to describe this property of selection. 

The concept of "take over time" quantifies selection 
pressure by the number of generations required by re- 
peated application of selection, to fill the complete popu- 
lation with copies of the single initially best individual [6J . 
There have been some adaptations of definitions from 
population genetics for selection intensity. The change 
in average fitness of the population due to selection is a 
reasonable measure of selection intensity ^l|. Also note 
that several of these measures depend on fitness distri- 
bution at that instance. Details of selection intensity 
measures can be found in 0, IE EI ■ 

We measure selection strength w.r.t an NFD using the 
metric d as distance between the NFD before the selec- 
tion and after selection. Let r : O — > O be the selection 
operator. The selection strength can be measured as: 



(14) 



Let {P n } be the evolutionary process, where P n is 
population at generation n. We represent correspond- 
ing Boltzmann selection scheme as {F(„)} where rV n ) is 
an operator Ti n > : O — > O and is defined as: 



Pn(x) = r (n )<p n _i(a:) 



(p n -i(x)e~<" 



Mx e IR , Vn = 1,2,.. . , (18) 



xeE v 



where cp n G O. {j n } is annealing schedule for the Boltz- 
mann selection scheme {F(„)} and 7„ > Vn = 1,2 

Also {7n} is a non-decreasing sequence since j n repre- 
sents the inverse temperature |9(. 



B. Cauchy Criteria 

Our Hypothesis for Boltzmann selection schedule is: 

The difference between successive selection 
pressures should decrease as the evolutionary 
process proceeds. 

We formalize above hypothesis as Cauchy criteria for 
Boltzmann selection schedule as follows: 
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Definition III.l A Boltzmann selection schedule {F(„)} 
is said to satisfy Cauchy criteria if {T/ n \(p} C O is 
Cauchy with respect to metric d, \fip G O. 

We justify the fact that Cauchy criteria for Boltzmann 
selection schedule captures the hypothesis by the follow- 
ing lemma. 

Lemma III. 2 Let I\ and T 2 be two Boltzmann selection 
operators. Then for any tp G O , difference between these 
selection strengths satisfies 

\S v (Ti) - S V {T 2 )\ < <i(r m l» . (19) 

Proof: From Definition III. 51 we have 

|5 v (Ti) - S V (T 2 )\ = \d(cp,T lip ) - d(<p,T 2 <p)\ • 

From triangular inequality we have 

d((p, Ttip) < d((p,T 2 ip) + d(Tnp, F 2 cp) , 

which gives 

d{r^, t 2V ) > d(<p, i» - d(<p, r 2¥ ?) . (20a) 

Similarly we have 

d(ri<p t r 2 tp) > d(<p,r 2 <p) - d(<p,ri<p) . (20b) 

From (|2l)a[) and (j20b|) we get 

d(r 1 <f,r 2 tp) > \d(<p,rnp) - d(ip,r 2 ip)\ . 

m 

Hence decrement in d(Ti(p,T 2 (p) results in decrement 
in the difference between selection strengths. From the 
definition of Cauchy sequence justification is clear. 

Note that above criteria is stated in terms of the se- 
lection operator. Based on this we derive an anneal- 
ing schedule for inverse temperature parameter 7„ in the 
next section. 

C. Derivation of Cauchy Annealing Schedule 

We summarize Cauchy criteria for Boltzmann selection 
schedule {r( n )} as: 

(CB1) {7„} is non-decreasing sequence 
(CB2) {r (n) ip} C O is Cauchy \/(p G O 
For {r(„)} to satisfy (CB1) we define 

n 

ln = Y,9k ,where{ fffe }cIR + U0,V7i = l,2,... . (21) 

fe=i 

Clearly {7,1} is non decreasing sequence. Then Boltz- 
mann selection schedule {T^} defined as 

r / \ <f( x ) ex POELifffc) w ^ to 

r (n)<P(?) = ^ I77a — _/..v^n TT 1 G IR 



Eaes^ <p(y) ex p(y Efe=i 9k) 



for arbitrary {g k } C M + U {0} satisfies (CB1). Now we 
derive annealing schedule for {7„ = Efe=ifffc} f° r the 
selection schedule {r( n )} to satisfy (CB2). First we prove 
following inequality 

Lemma III. 3 Let {F( n )} be a sequence of Boltzmann se- 
lection operators defined as in then for any NFD 
(fi G O, we have 

d(T {n) {(p),T {m) (ip)) < ^2 exp(a; ^ g k ) - 1 



k—m+l 



whenever n > m and n,m G 
Proof: Denote 



C n {x) = tp(x) exp(x ^2 9k) Vx G £y 



k=l 



Then, 

d(T' n )(<p),T, m) ((p)) = 



E 



ieEr (n)M u£ r w (v) 



C n (x) 



C m {x) 



Since supp(tp) D supp(T n (ip)) U supp(T m (</?)) and 
supp(C n ) = supp(ip) Vn we can write 



^( r (™)(^),r (m) (^)) = 



E 



C n (x) 



C m (x) 



YsyeE^Cniy) YsyeE^Cmiy) 



< 



= VtT] E \C n (x) - C m (x)\) , (23) 

since for n > m, C n {x) > C m (x), \fx > 0. 
We have, 

n 

C n {x) = (p(x) exp(x^g k ) 

k=l 

tci n 

= (p{x) exp(x^2 g k ) exp(x ^2 g k ) 

k—1 k— m+1 

Th 

= C m (x)exp(x ^2 9k) , Vx G E v . (24) 



k=m+l 



Hence we can write (|23ll as 



12xGE v C m (x) 



(22) 



E 

\x£E^ 



C m (x) exp(x ^2 9k) - 1 

\ k=m+l / 
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< 



\ 



{C m {x)} 2 ^ Uxp(x ^ 9k) -1 
x£E v x£E v K k=m+l , 



by Cauchy-Schwartz-Bunyakovsky inequality. 

Since C m {x) and exp(xJ2k=m+i 9k) ~ 1 are positive, we 

have 



d(T {n) {f ),r {m) (ip)) < 



\ 



x<£E v 



x£LE,~ k— m+1 



d{T {n) (ip),T {m) {ip)) < Y (exp(a; ^ g k ) - 1 

xGEy, \ k=m+l J 



(25) 



We now give our main result which gives condition on an- 
nealing schedule {7™} for Boltzmann selection to satisfy 
Cauchy criteria. 

Theorem III. 4 Let {r(„)} fee a sequence of Boltzmann 
selection operators defined as in \2ty) . Then, 



< J^5fc \ is Cauchy => {T^ip} is Cauchy 

U=i J („) 

Vip GO and for any {g k } C IR+ U {0}. 

Proof: {T( n j(p} is Cauchy for any ip G O if 
Ve >0,3N = N(e) G Z + 3 

n,m>N^ d(T {n) (ip),T^ m )(ip)) < e . 

Now consider d(F(„)((p),r( m )(<y9)). With out loss of gen- 
erality assume that n > m. From Lemma IlII . 31 we have 

d{T {n) (ip),T {m) {ip)) < Y (exp(a; ^ 9k) -l) ■ 

xSLE^p \ k— m+1 / 

Let e > arbitrary. So, 

X] ( ex P( x H 9k) - 1 j < e 

x€LE v \ k— m+1 / 

d ( r (n)(^),r (m) (^)) < e . (26) 



Hence it is enough to prove that 

3N = N(e) G ^ + 9 n, m > TV => 

^ exp(a: ^ 5fc ) - 1 < e 



(27) 



x£E v 



A;— m+1 



Now let £L = r < 00 since is finite. We 

thus have to prove that 



37V = N{e) G % + 3 n,m > N => 
^ I exp(xi ^ fffc) — 1 J < e 

i=l \ fc=m + l / 

Now it is enough if we show that 

3N t = Ni(-) //. ■ n.iu X, 



r 



(28) 



(29) 



exp(xi Y 9k) - 1 < - , Vi = 1 . 

fc— m+1 



For TV = maxjiVj : i = 1 . . . r} 



n,m > N ^r- exp(a;i gr^) — 1 < - , Vi = 1 

k— m+1 

which gives us 



(30) 



i, m > N Y exp(xj ^ 5fc) ~ 1 < ^ ~ = e 

i—1 k— m+1 i—l 



(31) 

Now to assert (12911 it is enough, for a fixed x G , if we 
have following 



Ve' > 0, 3N' = N'(e') G Z 3 n,m > N' 



ex P ( x Y ! 

\ A;— m+1 



Ke' 



Note that e' can be chosen as e' = -, and e' is arbitrary 
since e arbitrary. Since 



exp(x Y 9k) - 1 < e' =*> ^ g fc < 

fc— m+1 fc— m+1 

it is enough if 



ln(e' + l) 



Ve" > 0, 37V" = N"(e") e% + 3n,m> N" =^ 

n 

E 5fc < e" . (32) 

fc=m+l 

Note that e" can be chosen as e" = ln ( e for a fixed 
x G -E and e" is arbitrary since e' is arbitrary. 
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Since e" is arbitrary l|32[l can be asserted if the sequence 

{i>} 

U=i ) („) 

is Cauchy by the definition of Cauchy sequence. 



IV. SIMULATION RESULTS 
A. Choice of {gk} 
As a specific case, for {gk} to satisfy 1|21[1 . we choose 

where go is any constant and a > 1. Since {Efc=i 
is a Cauchy sequence for any a > 1 0], {go Efc=i F^} n 
is also a Cauchy sequence. In this specific choice of se- 
quence, a plays an important role in the annealing sched- 
ule (see Figure P). 
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FIG. 1: Cauchy Annealing Schedules for Different Values of 
a where 7 is defined according to 1341 1 



Here we give simulation results using the annealing 
schedule {7,1} defined as 

n n ^ 

k=l k-1 

B. Results 

We discuss the simulations conducted to study the an- 
nealing schedule for Boltzmann selection proposed in this 
paper. We compare three selection mechanisms viz., pro- 
portionate selection {proportionate) , Boltzmann selection 
with constant 7 (Boltzmann) and Boltzmann selection 



with proposed Cauchy annealing schedule {j n } (Cauchy- 
Boltzmann). We study multi- variable function optimiza- 
tion in the framework of genetic algorithms. Specifically, 
we use the following functions [Tlj : 

• Rastrigin's function: 

fe(x) = IA + xf - Acos(27ra; 4 ), 

where A = 10 ; -5.12 < x l < 5.12 

• Griewangk's function: 

/8(^) = ELife-nLcos(^) + i, 

where -600 < x z < 600 

• Ackley's function: 

f 9 (x) = -20exp(-0.2^}£Li^ 2 ) 

- exp(} Yl\=i cos(27ra;j)) + 20 + e, 
where — 30 < xt < 30 

• Schwefel's function: 

where -500 < x z < 500 

The following parameter values have been used in all 
the experiments: 

• Each Xi is encoded with 5 bits and I = 15 i.e search 
space is of size 2 75 

• Population size np = 150 

• For Boltzmann selection the inverse temperature 
7 = 300. For Boltzmann selection with annealing, 
we vary a = 1.0001, 1.1, 1.5, 2 and we chose go for 
each value of a in such a way that, 7100 = 300 
where 100 is the total number of generations for 
each process. Figure |2 shows the plots of values of 
7„ for a = 1.0001,1.1,1.5,2. 

• For all the experiments probability of uniform 
crossover is 0.8 and probability of mutation is below 
0.1 

• Each simulation is performed 17 times to get the 
average behavior of the process 

From various simulations we observed that when the 
problem size is small (for example smaller values of I) all 
the selection mechanisms perform equally well. Boltz- 
mann selection is effective when we increase the problem 
size. In the case of Boltzmann selection with constant 
7, one has to increase the value of 7 when the problem 
size is large. Note that choice of parameter a is very 
important for Cauchy annealing schedule and it depends 
on the specific problem. Here we have given results cor- 
responding to the best values of a. Figures O El El El 
show the plots for behavior of the process when averaged 
over multiple runs. Figures and |S] show plots for single 
run. Our simulations showed that Boltzmann selection 
with the Cauchy annealing schedule performs better than 
other mechanisms. 
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FIG. 2: j n for a = 1.0001,1.1,1.5,2 where 7„ is defined 
according to 13411 
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FIG. 5: Griewangk: a = 1.1 (Multiple Runs) 




70 80 90 100 




proportionate 
Boltzmann ■ 
Cauchy-Boltzmann • 



10 20 30 40 50 60 

generations 



70 80 90 100 



FIG. 3: Rastrigin: a = 2 (Multiple Runs) 



FIG. 6: Schwefel: a = 1.5 (Multiple Runs) 




generations generations 

FIG. 4: Ackley: a = 1.1 (Multiple Runs) FIG. 7: Rastrigin: a = 2 (Single Run) 
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generations 

FIG. 8: Ackley: a = 1.1 (Single Run) 



without annealing schedule and Boltzmann selection with 
the proposed annealing schedule. We found that with an 
appropriate choice of speed of annealing, algorithms with 
annealing schedule outperform other methods. 

This analysis does not consider any of the genetic op- 
erators. Our future work would involve comprehensive 
analysis which leads to more generalized selection sched- 
ules based on the techniques presented in this paper. 

One important consequence of techniques we devel- 
oped in this paper would be proving convergence of the 
process. If one can show that the underlying space, for 
example spaces of NFDs, is complete (see Appendix for 
the definition of complete metric space), one can con- 
clude the convergence of evolutionary process, based on 
the Cauchy criteria. 
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V. CONCLUSIONS 

In this paper we derived an annealing schedule for in- 
verse temperature parameter in the Boltzmann selection 
scheme, which is based on Cauchy criteria for Boltzmann 
selection schedule. Usage of Cauchy criteria for Boltz- 
mann selection schedule is justified by the hypothesis: as 
process goes on 

• selection strength should increase, 

• difference between the selection strengths should 
decrease. 

We have given alternative formalism for selection 
mechanisms based on the fitness distributions. We have 
also given a new measure for selection strength which is 
suitable for theoretical analysis. 

Using the above formalism, we presented an impor- 
tant mathematical result for Boltzmann selection sched- 
ule; using which we derived the annealing schedule. 
Cauchy annealing schedule is a generalized mechanism 
from which one can choose different specific sequences 
for annealing based on the problem at hand. 

Our simulation results justify the hypothesis we pre- 
sented and the utility of techniques we used; they also 
support usage of the mathematical results we presented, 
in practice. We conducted experiments using specific 
annealing schedule, where one can choose the speed of 
(inverse) annealing. We compared our results with algo- 
rithms with proportionate selection, Boltzmann selection 
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APPENDIX A: METRIC SPACES 

Here we present some basic concepts of metric spaces 
used in this paper. 

Let X be any set. A function d : X x X — > IR is said 
to be metric on X if 

1. d(x, y) > and d(x, y) = x = y , Va:, y e X 

2. d(x, y) = d(y, x) , Vx,y E X 

3. d(x, y) < d(x, z)+d{z, y) , \/x, y, z G X (Triangular 
inequality) 

Example of metric space is IR with | . | as a metric. 
A sequence {x n } is said to be Cauchy sequence if 



Ve > 0, 3N = N(e) e Z + 3 



n,m > N =4> d(x n ,x m ) < e . 

We say metric space (X, d) is complete if every Cauchy 
sequence in X converges. 
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